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ABSTRACT 

In 1992 the University of South Alabama instituted a 
doctoral program in Instructional Design and Development. A survey 
was designed to help assess entry competencies of incoming students, 
monitor student development through the educational program, and 
assess program effectiveness. Students were also asked to choose 10 
competencies that they believed were worth developing. Sixty-seven 
surveys were returned by master's and doctoral students in the fall 
of 1992 and 1993. Results indicated that incoming students rate 
themselves most highly in general management skills, while faculty 
rate them most highly in oral communication skills. Overall, the 
faculty rates students lower than the students rate themselves. To 
the 16 competencies identified in a review of the literature, 
students most often added the need for competencies in multimedia and 
computer-based instruction. The faculty members do not have a clear 
consensus of the top competencies students should acquire. Continued 
evaluations as the new program matures should define needed 
competencies more clearly. Three tables present study findings, and 
the survey instrument is attached. (Contains 6 references.) (SLD) 
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Introduction 

In the early 1980s, competencies needed by instructional designers were proposed by AECT, 
the International Board of Standards for Training Performance and Instruction (IBSTPI), and 
various instructional design professionals (e.g., Bratton, et. al., 19810, Deden, Parker, 1981, 
Wallington, 1981, Redfield & Dick, 1984, IBSTPI, 1986). These competencies ranged from 
determining projects suitable for an instructional solution to summative evaluation of a project. 
They have naturally been used as development guidelines of formal programs for study in 
instructional design (Silber, 1984). 

The implementation of a new program provides unique opportunities to evaluate and monitor 
student development. In September, 1992, the University of South Alabama (USA) initiated a 
doctoral program in Instructional Design and Development (ID&D). Building upon an in-place 
Masters of Science program, the doctoral program was developed to expand and enhance 
instructional design research and practice. 

To help assess entry competencies of incoming students, monitor student development through 
the educational program, and assess program effectiveness, a survey (see Appendix A) was 
designed. In part, the survey permits students an opportunity to self-assess their instructional 
design and development competencies. Students were also asked to choose ten competencies which 
they believed were most important for them to develop. These data form a benchmark and initial 
database for a continuing study. 

This discussion reports the nature and program implications of benchmark data based on 
student responses. A related faculty survey was conducted to explore faculty views of beginning 
student competence and the top competencies they expect students to acquire. Results from the 
two surveys were compared to interpret perceptions of both groups. 

Major questions we attempted to answer in these preliminary surveys were: 

1. In what competency areas do incoming ID&D students consider themselves strong and which 
do they consider themselves weak? How do these compare to faculty perceptions. 

2. How do the competencies that ID&D students consider to be most important to develop 
compare to those reported to be most important in our professional literature. 

3. How do master students self-reported competencies differ from those of doctoral students. 

4. Which competencies do faculty consider to be most important for student development and how 
do these compare to those reported in the literature. 

Method 

In September, 1992, the USA implemented a doctoral program in ID&D. Twenty-two students 
were admitted. A Masters program had been in place for several years, with 54 active students in 
Fall, 1992. An additional 14 doctoral students were admitted to the program in 1993. Thirty-two 
additional masters students were admitted between January and September 1993. All students 
were sent a survey upon admittance. Follow-up surveys were sent to those who did not respond 
within one month. 

During the summer of 1993, all USA ID&D faculty were distributed two surveys: one for 
doctoral students and one for masters students. They were instructed to assess competencies of the 
typical incoming student and select the top ten competencies graduating students would need to 



develop. 



Results 

One hundred and fourteen surveys were distributed to masters and doctoral student in Fall 
Quarters of 1992 and 1993. Sixty-seven were returned. These data were analyzed to determine 
students' current skill levels. Table 1 describes the top perceived student competencies students 
and faculty assessment of those competencies. 



Table 1 

Top 10 Student (Ph.D. and M.S.) Self-Reported Competencies Compared to Faculty 
Perception of Those Competencies 



Competency 


Student Self-Reported 
Mean (n) (1:6) 


Faculty Assessment 
Mean (n=5) (1:6) 


PhJ3 .. ■ • 






demonstrate general management skill (Q36) 


4.97 (36) 


2.70 


communicate effectively in writing (Q29) 


4.08 (36) 


3.30 


deliver presentations (Q47) 


4.00 (36) 


3.10 


develop and sustain professional relationships (Q43) 


3.94 (36) 


3.10 


communicate effectively orally (Q28) 


3.83 (36) 


3.70 


participate in professional organizations (Q44) 


3.78 (36) 


2.77 


demonstrate appropriate interpersonal and group process 
behaviors (Q30) 


3.67 (36) 


3.50 


communicate visually (Q27) 


3.61 (36) 


3.10 


manage the work of work of others (Q13) 


3.60 (35) 


2.90 


write or edit copy of instructional materials (Q07) 


3.28 (36) 


3.30 


M.S. 






communicate effectively in writing (Q29) 


3.92 (26) 


2.50 


develop and sustain professional relationships (Q43) 


3.69 (26) 


2.30 


communicate visually (Q27) 


3.54 (26) 


2.10 


communicate effectively orally (Q28) 


3.50 (26) 


3.10 


deliver presentations (Q47) 


3.44 (27) 


1.90 


demonstrate general management skill (Q36) 


3.40 (25) 


1.20 


demonstrate appropriate interpersonal and group behaviors 
(Q30) 


3.38 (26) 


3.10 


negotiate with small groups for particular purposes (Q49) 


3.12 (26) 


1.88 


write or edit copy of instructional material (Q07) 


2.89 (27) 


1.50 


analyze instructional objectives into subordinate skills (Q04) 


2.81 (26) 


.80 



As a whole, master's students and doctoral students have completed similar numbers of 
instructional design courses. Fifty percent of doctoral students, however, had no instructional 
design courses. Only 24% of masters students had not had taken any courses. This difference can 
be explained by the newness of the doctoral program; all doctoral students were new to the 



program. Because the masters program was a continuing one, survey respondents would naturally 
have had more courses than new, in-coming students. 

The role of ID&D or instructional technology programs is often perceived as that of training 
graduate students in basic standard competencies (Silber, 1984). Some of the most common of 
these competencies are listed in Table 2. The last two columns rank-orders top competencies that 
USA ID&D students and faculty felt were important to develop. 

The 16 competencies proposed as a result of the extensive IBSTPI efforts are considered by 
some practioners to be the standard for the field. Table 3 contains student self-assessment and 
faculty assessment of student skills in each of these competencies. Student assessment is 
individual self-assessment at the time of survey. Faculty assessment is based on perceptions of 
incoming student skill levels. 

The combined competency rating of all students (M.S. and Ph D.) was 2.55. Doctoral students 
had a slightly higher competency mean than masters students (2.80:2.28). Masters students had a 
slightly higher mean in the number of ID&D courses taken (3.24:2.93). Doctoral students appear to 
be more confident in the individual skills making up the instructional design process. 

Discussion 

The results of the survey provide preliminary answers to our stated questions. Future 
investigation will shed additional light on these results. As students begin to graduate from the 
program, examination of the change in competency levels will help evaluate the effectiveness of the 
graduate program and the quality of graduates. 

1. In what competency areas do incoming ID&D students consider themselves strong and which do 
they consider themselves weak? How do these compare to faculty perceptions. 

Incoming students rate themselves most highly in demonstrating general management skills (Q36). 
Faculty rate new students most highly in the ability to communicate orally (Q28). Faculty, overall, 
rate students lower than students assess themselves. One explanation for this disparity may be 
that because students have little experience in the ID&D field, they have a less sophisticated 
comprehension of what the competencies mean. Also, faculty may see each competency as an 
integral part of a whole and the subsequent educational experience as developing overall ID&D 
skills. 

2. How do the competencies that ID&D students consider to be most important to develop compare 
to those reported to be most important in our professional literature. 

The most marked competency addition by USA ID&D students concerned multi-media and CBI 
development. The three major groups of competencies do not mention use of technology as a skill. 
USA's students are required to complete specific technology-based objectives and courses. This 
requirement may have influenced the student's perceptions of important skills to develop. 

Students also included application of research and learning theory (echoing faculty perceptions). 
This is also an integral part of USA's program. Students are grounded in the theory behind the 
practice. Practical aspects of the other three lists do not explicitly address theoretical basis of 
instructional design. 

As students begin to graduate from the program, comparison of what they believed to be important 
when they began the program will be compared to current perceptions. As they learn more about 
instructional design and its processes, their conceptions of important competencies may change to 
reflect closer matchings with industry standards. 
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3. In what ways do master students self -reported competencies differ from those of doctoral 
students. 

In all reported cases, doctoral students reported higher mean competencies than masters students. 
This may be attributed to doctoral students having completed masters degrees which increased 
confidences in their own skill attainment. 

4. Which competencies do faculty consider to be most important for student development and how 
do thes? compare to those reported in the literature. 

USA faculty do not show a clear consensus of the top competencies students should have (see Table 
2). While most agree that learning theory is important (n=9) and students should communicate 
effectively in writing (n=7), agreement in other areas are not as cohesive. Thirty-nine out of 62 
competencies were chosen by a least one faculty member as being part of their "Top-10 List." 
Faculty-selected competencies, like those selected by students, contain strong theoretical basics- 

Conclusion 

Professions have basic skills and components that make them professions. Training new 
practioners in these skills ensure that the profession maintains its standards. Knowledge and 
application of those components help ensure consistency throughout the profession. 

New instructional design programs depend on published and perceived competencies. As the 
program at USA matures, further evaluation of student development will be conducted. These 
continued evaluations will be used to enhance USA's program to ensure that students acquire the 
competencies they need to succeed as instructional designers. Further review of the competencies 
and enhancement, if necessary, will assure continued sucess of instructional designers. 
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